Leitmann's direct method of optimization 
for absolute extrema of certain problems 
of the calculus of variations on time scales* 

Agnieszka B. Malinowska^ Delfim F. M. Torres 
abmalinowska@ua.pt delfim@ua.pt 

Department of Mathematics 

University of Aveiro 
3810-193 Aveiro, Portugal 



Abstract 

The fundamental problem of the calculus of variations on time 
scales concerns the minimization of a delta- integral over all trajectories 
satisfying given boundary conditions. This includes the discrete-time, 
the quantum, and the continuous/classical calculus of variations as 
particular cases. In this note we follow Leitmann's direct method to 
give explicit solutions for some concrete optimal control problems on 
an arbitrary time scale. 
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1 Introduction 



The calculus on time scales is a recent field that unifies the theories of differ- 
ence and differential equations. It has found applications in several contexts 
that require simultaneous modeling of discrete and continuous data, and is 
nowadays under strong current research in several different areas (6J [7] . 

The area of the calculus of variations on time scales, which we are con- 
cerned in this paper, was born in 2004 [5] and is now receiving a lot of 
attention, both for theoretical and practical reasons - see [U [2j [31 HJ [121 
[T3| |2~T| [22| [23] and references therein. Although the theory is already well 
developed in many directions, a crucial problem still persists: solving Euler- 
Lagrange delta- differential equations on arbitrary time scales is difficult or 
even impossible. As a consequence, there is a lack of concrete variational 
problems for which a solution is known. In this paper we follow a different 
approach. We show that the direct method introduced by Leitmann in the 
sixties of the XX century [T5] can also be applied to variational problems on 
time scales. Leitmann's method is a venerable forty years old method that 
has shown through the times to be an universal and useful method in several 
different contexts - see, e.g., 0El[TniinilISlinilISllISll2Qll21ll251l25]. Here 
we provide concrete examples of problems of the calculus of variations on 
time scales for which a global minimizer is easily found by the application of 
Leitmann's direct approach. 

2 Preliminaries on time scales 

A time scale T is an arbitrary nonempty closed subset of the set R of real 
numbers. It is a model of time. Besides standard cases of R (continuous 
time) and Z (discrete time), many different models are used. For each time 
scale T the following operators are used: 

• the forward jump operator a : T— >T, o~(t) := inf{s G T : s > t} for 
t < sup T and <r(sup T) = sup T if sup T < +oo; 

• the backward jump operator p : T— >-T, p(t) := sup{s G T : s < t} for 
t > inf T and p(inf T) = inf T if inf T > -oo; 

• the graininess function fi : T— y[0, oo), fi(t) := a(t) — t. 
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For T = R one has a(t) = t = p(t) and /x(t) = for any tel. For T = Z 
one has a(t) —t + 1, p(t) — t — 1, and fi(t) = 1 for every £ G Z. 

A point i G T is called: (i) right-scattered if ct(£) > t, (ii) right- dense if 
<r(t) = t, (hi) left- scattered if p(t) < £, (iv) left-dense if p(t) = i, (v) isolated if 
it is both left-scattered and right-scattered, (vi) dense if it is both left-dense 
and right-dense. If sup T is finite and left-scattered we set T K := T \ {sup T}; 
otherwise, T K := T. 

We assume that a time scale T has the topology that it inherits from the 
real numbers with the standard topology. Let / : T— >-R and t G T K . The 
delta derivative of / at t is the real number f A (t) with the property that 
given any e there is a neighborhood U = (t — S, t + 8) fl T of t such that 

\UXa(t))-f(s))-f A (t)(a(t)-s)\<e\a(t)-s\ 

for all s G U. We say that / is delta- differentiable on T provided f A (t) exists 
for all t G T K . 

We note that if T = R, then / : R->R is delta differentiable at t G R if 
and only if / is differentiable in the ordinary sense at t. Then, f A (t) = f'(t). 
If T = Z, then / : Z— >R is always delta differentiable at every t G Z with 
/ A (t) = /(t + l)-/(t). 

A function / : T — > R is called rd-continuous if it is continuous at the 
right-dense points in T and its left-sided limits exist at all left-dense points 
in T. The set of all rd-continuous functions is denoted by C r d- Similarly, C\ d 
will denote the set of functions from C r d whose delta derivative belongs to 
C r d- A continuous function / is piecewise rd- continuously delta- differentiable 
(we write / G C^ rd ) if / is continuous and f A exists for all, except possibly at 
finitely many t G T K , and f A G C r d- It is known that piecewise rd-continuous 
functions possess an antiderivative, i.e., there exists a function F with F = 
f, and in this case the delta-integral is defined by J f(t)At = F(d) — F(c) 
for all c,deT. If T = R, then 

b b 

J f(t)At = J f(t)dt, 

a a 

where the integral on the right hand side is the usual Riemann integral; if 
T = hZ, h > 0, and a < b, then 

b 

I f(t)At = J2h- f(kh) . 

J 7 a 
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For / : T— >X, where X is an arbitrary set, we define f a := / o a. 

3 Leitmann's direct method on time scales 

Let T be a time scale with at least two points. Throughout we let a, b G T 
with a < b. For an interval [a, b] fl T we simply write [a, b}. 

The problem of the calculus of variations on time scales consists in mini- 
mizing 

C[x] = f L(t,x a (t),x A (t))At 

J a 

over all x G CL. d ([a, b], R) satisfying the boundary conditions 

x(a) = a, x{b) = (3, (1) 

where a, (3 G R and L : [a,ifxlxK->M. We assume that (t,y,v) — »■ 
L(t,y,v) has partial continuous derivatives L y and L^, respectively with re- 
spect to the second and third arguments, for all t G [a, b] K , and L(-,y,v), 
L y (-, y, v) and !/„(-, t> ) are piecewise rd-continuous in t for all x G CL rf ([a, 6], R). 
A function x G C^Qa, 6], R) is said to be admissible if it satisfies the bound- 
ary conditions ([T|). 

Let L : [a.ifxtxl-jR. We assume that {t,y,v) — > L(t,y,v) has 
partial continuous derivatives L y and L„, respectively with respect to the 
second and third arguments, for all t G [a, b] K , and L(-,y,v), L y (-,y,v) and 
L v (-, y, v) are piecewise rd-continuous in t for all x G Cp rd ([a, b], R). Consider 
the integral 

= / L(t,x a (t),S; A (t))At 

J a 

Lemma 3.1 (Leitmann's fundamental lemma). Let x = z(t,x) be a trans- 
formation having an unique inverse x = z(t,x) for all t G [a, b] such that 
there is a one-to-one correspondence 

x(t) ^ x(t), 

for all functions x G Cp rd ([a, b], R) satisfying ([T|) and all functions x G 
C prd(l a > b }^) satisfying 

x = z(a,a), x = z(b,f3). (2) 
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// the transformation x = z(t, x) is such that there exists a function G 
[a,b] xl-^R satisfying the functional identity 



L(t, x a (t),x A (t)) - L(t, x a (t),x A (t)) = G A (t, x(t)) 



(3) 



then if x* yields the extremum of £ withx* satisfying (J2J), x* = z(t,x*) yields 
the extremum of £ for x* satisfying <^ . 

Proof. The proof is similar in spirit to Leitmann's proof [E)J EESJ H7J [2D]- Let 

x G Cp rd ([a, b], R) satisfy and define functions x G Cp rd ([a, b], M) through 
the formula x = z(t, x), a < t < b. Then x G Cp rd ([a, &],R) and satisfies ([2]). 
Moreover, as a result of ([3]) , it follows that 



from which the desired conclusion follows immediately since the right-hand 
side of the above equality is a constant depending only on the fixed-endpoint 



4 An illustrative example 

Let a, b G T, a < b, and a and j3 be two given reals, a ^ j3. We consider the 
following problem of the calculus of variations on time scales: 



£[x] - £[x] 




G(b,z{b, /?)) - G(a,z(a,P)) 



conditions (JTJ). 



□ 



minimize £[x] 




(4) 



x(a) = a , x(b) = (3 . 



We transform problem (j3J) into the trivial problem 




x(a) = 0, x(b) = 
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which has the solution x = 0. For that we consider the transformation 

x(t) = x(t) + ct + d, c,deR, 

where constants c and d will be chosen later. According to the above, we 
have 

x A (t) = x A (t) + c, x a {t) = x a (t) + ca{t) + d 

and 

L(t, x CT (t),x A (t)) = (x A (t)) 2 + x a {t) + tx A (t) 

= (x A (t)) 2 + 2cx A {t) + c 2 + x a {t) + ca{t) + d + tx A (t) + ct 
= L(t, x a {t),5: A {t)) + [2cx(t) + tx(t) + ct 2 + (c 2 + d)t] A . 

In order to obtain the solution to the original problem, it suffices to chose c 
and d so that 

ca + d = a 

cb + d = fi. { ' >] 

Solving the system of equations ([5]) we obtain c = an d d = Z.h' ■ Hence, 
the global minimizer to problem (j4j) is 

, . a — 8 Ba — ba 
x(t) = + — . 



5 Optimal control on time scales 

The study of more general problems of optimal control on time scales is in 
its infancy, and results are rare (see [221 12Z] for some preliminary results). 
Similar to the calculus of variations on time scales, there is a lack of exam- 
ples with known solution. Here we solve an optimal control problem on an 
arbitrary time scale using the idea of Leitmann's direct method. Consider 
the global minimum problem 

minimize C[ux,u 2 ] = [ ((u^t)) 2 + u 2 (t)) 2 ) At (6) 

Jo 

subject to the control system 

x A (t) = exp(wi(t)) + ui(t) + u 2 {t) . 
x A (t)=u 2 (t), 
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and conditions 



xi(0) = 0, xi(l) = 2, x 2 (0) = 0, x 2 (l) = l, 

Ui(t),M 2 (t) Gfi = [-1,1]. 



(8) 



This example is inspired in [25]. It is worth to mention that a theory based 
on necessary optimality conditions on time scales to solve problem (jH])-© 
does not exist at the moment. 

We begin noticing that problem (JHJl-flBJ) is variationally invariant according 
to [H] under the one-parameter transformations^ 

x{ = Xi + st , x s 2 = x 2 + st , u 2 = u 2 + s (t s = t and u{ = ui) . (9) 

To prove this, we need to show that both the functional integral £[•] and 
the control system stay invariant under the s-parameter transformations <^j. 
This is easily seen by direct calculations: 



We remark that C s and C have the same minimizers: adding a constant 
s 2 + 2s to the functional £ does not change the minimizer of C. It remains to 
prove that the control system also remains invariant under transformations 



(xi(t)) A = + st) A = x A {t) + s = exp(u x (t)) + u x (t) + u 2 (t) + s 



(a£(f)) A = (x 2 (*) + st) A = x A {t) + s = u 2 {t) + s = u s 2 (t) . 

Conditions (jlOH and (TTTT) prove that problem (jS])-® is invariant under the 
s-parameter transformations ([9]) up to (s 2 t + 2sx2) A - Using the invariance 

1 A computer algebra package that can be used to find the invari- 
ance transformations is available from the Maple Application Center at 
http: //www.maplesof t . com/applications/view. aspx?SID=4805 




JO 

u 2 ] + s 2 + 2s . 



(10) 



expK(t)) +u{{t) + u s 2 (t) 



(11) 
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transformations (JHJ), we generalize problem (jS])-© to a s-parameter family 
of problems, s£l, which include the original problem for s = 0: 

minimize C a [u a 1 ,u a 2 ] = f K(£)) 2 + (u s 2 (t)) 2 At 

Jo 

subject to the control system 

{x{{t)) A = exp«i)) + ut(t) + u s 2 (t) , 
(x|(t)) A = ul{t) , 

and conditions 

x s 1 (0) = 0, x s 1 (l)=2 + s, ar*(0) = 0, x s 2 {l) = 1 + s , 

Ul(t) G [-1,1], U S 2 (t) E [-1 + 8,1 + 8]. 

It is clear that C s > and that C s = if uf(t) = "u|(t) = 0. The control 
equations, the boundary conditions, and the constraints on the values of 
the controls, imply that iff(t) = u 2 (t) = is admissible only if s = — 1: 
x^ =_1 (t) = t, X2 =_1 (t) = 0. Hence, for s = —1 the global minimum to C s is 
and the minimizing trajectory is given by 

ul(t) = 0, u s 2 (t) = 0, xl(t) = t, x s 2 (t) = 0. 

Since for any s one has by ffTOj) that £[ui,u 2 ] = C s [u\,u s 2 } — s 2 — 2s, we 
conclude that the global minimum for problem £[ui,u 2 ] is 1. Thus, using 
the inverse functions of the variational symmetries (Q, 

Ui(t) = u{(t) , u 2 (t) = u 2 (t) - s , xx(t) — x\(t) — st , x 2 (t) = — st . 

The absolute minimizer for problem (JHJ)- (JHJ) is 

u 1 (t) = 0, u 2 (t) = l, x 1 (t) = 2t, x 2 {t) = t. 
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